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PIPELINE ACCELERATOR FOR IMPROVED COMPUTIMG ARCHITECTURE 
AND RELATED SYSTEM AND METHOD 

CLAJM OF PRIORITY 

[1] This application claims priority to U.S. Provisional Appiication Serial 

5 No. 60/422,503, filed on October 31, 2002, which is incorporated by reference. 

Cross referemce to related applications 

PI This appiication is related to U.S, Patent App. Serial Nos. 10/684,102 

entitied IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD, 10/684.053 entitled COMPUTtNG MACHINE HAVING fMPROVED 

10 COypUTING ARCHiTECTURE AND RELATED SYSTEM AND METHOD, 

10/684,057 entitled PROGRAMyABLE CIRCUIT AND RELATED COMPUTING 
MACHINE AND METHOD, and 10/683,932 entitled PIPELINE ACCELERATOR 
HAVING MULTIPLE PIPELINE UNITS AND RELATED COMPUTING MACHINE 
AND METHOD, all filed on October 9, 2003, and having a common owner, and 

15 which are incorporated by reference. 

Background 

[3] A common computing architecture for processing relatively large 

amounts of data in a reiativaly short period of time includes muitiple Interconnected 
processors that share the processmg bUftJen, By sharing the processing burden, 
20 these multiple processors can often process the data more quickly than a single 

processor can for a given clock frequency. For example, each of the processors can 
process a respective portion of the data or execute a respective portion of a 
processing algorithm. 

14] FI6« 1 is a schematic block diagram of a conventional computing 

25 machine iO having a multi-processor architecture. The machine 10 inciudes a 
master processor 12 and coprocessors 14i - f 4», which communfcate with each 
other and the master processor via a bus 16, an input port 18 for receiving raw data 
from a remote device (not shown in FIG, 1), and an output port 20 for providing 
processed data to the remote source. The machine 10 also includes a memory 22 
30 for the master processor 12, respective memories 24f - 24n for the coprocassors 14i 
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- 14n, and a memory 26 that the master processor and coprocessors share via the 
bus ie. The mamoiy 22 serves as both a program and a working memory for the 
master processor f 2, and each memory 24i - 24^ serves as both a program and a 
working memory for a respective coprocessor 14i - 14n. The shared memory 26 
5 allows the master processor 12 and the coprocessors f4 to transfer data among 
themselves, and from/to the remote device via the ports 1B and 20, respectively. 
The master processor 12 and the coprocessors 14 also receive a common clock 
signai that controfs the speed at which the machine 10 processes the raw data, 

|5J \n general, the computing machine 10 effectively divides the 

10 processing of raw data among the master processor 12 and the coprocessors 14. 
The remote source (not shown In FIG* 1) such as a sonar array loads the raw data 
Via the port IB into a section of the shared memory 26, which acts as a 
first-in-first^out (FfFO) buffer (not shown) for the raw data. The master processor 12 
retrieves the raw data from the memory 26 via the bus 16, and then the master 
15 processor and the coprocessors 14 process the raw data, transferring data among 
themselves as necessary via the bus 16. The master processor 12 toads the 
processed data into another FIFO buffer (not shown) defined in the shared memory 
26, and the remote source retrieves the processed data from this FiFO via the port 
20. 

20 16} In an example of operation, the computing machine 10 processes the 

raw data by sequentialiy performing n -M respective operations on the raw data, 
where these operations together compose a processing algorithm such as a Fast 
Fourier Transform (FFT)- More specificajfy, the machine 10 forms a data-processing 
pipeilne from the master processor 12 and the a>processons f 4. For a given 

25 frequency of the clock slgna}, such a pipeline often allows the machine 10 to process 
the raw data faster than a machine having only a singte processor, 

|7] After retrieving the raw data from the raw-data FIFO (not shown) in the 

memory 26, the master processor 12 periderms a first operation, such as a 
trigonometric function^ on the raw data. This operation yields a first resuit, which the 
30 processor 12 stores in a first-result FIFO (not shown) defined within the memory 26. 
Typically, the processor f 2 executes a program stored in the memory 22, and 
performs the above-described actions under the control of the program. The 
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processor f 2 may also use the memory 22 as working memory to tempofariiy store 
data that the processor generates at mtermediate intervals of the first operation, 

|B| Next, after retrieving the first result from the first-result FIFO (not 

shown) in the memory 26, the coprocessor 14i performs a second operation, such 
5 as a logarithmic function, on the first result. This second operation yields a second 
result which the coprocessor 14i stores in a second-result FIFO (not shown) defined 
within the memory 26. Typtcafly, the coprocessor 14i executes a program stored in 
the memory 24f, and performs the above«described actions under the control of the 
program. The coprocessor 14i may also use the memory 24i as working memory to 
1 0 temporarily store data that the coprocessor generates at Intermediate intervals of the 
second operatfon> 

|9| Then, the coprocessors 24^ - 24n sequentlaily perform third - n^^^ 

operations on the second ™ results in a manner similar to that discussed 
above for the coprocessor 24f - 

15 [101 The n*^ operation , which is performed by the coprocessor 24^, yields 

the final results Le., the processed data. The coprocessor 24n toads the processed 
data Into a processed-data FIFO (not shown) defined within the memory 26, and the 
remote device (not shown in FIG. 1) retrieves the processed data from this FIFO* 

f 1 1| Because the master processor 12 and coprocessors 14 are 

20 simultaneousiy performing different operations of the processing afgorithm, the 

computing machine 10 is often able to process the raw data faster than a computing 
machine having a single processor that sequentialiy performs the different 
operations. Spedficatfy, the single processor cannot retrieve a new set of the raw 
data yntii it performs ail n 1 operations on the previous set of raw data. But using 
25 the pipeline technique discussed above, the master processor 12 can retrieve a new 
set of raw data after performing only the first operation. Consequently, for a given 
dock frequency, this pipeline technique can increase the speed at which the 
machine 10 processes the raw data by a factor of approximateiy n 1 as compared 
to a single-processor machine (not shown in FIG. 1). 

30 [12] Attarnatfvety, the computrng machine 10 may process the raw data in 

parallel by simultaneously performing n + 1 instances of a processing afgorithm. 
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such as an FFT, on the raw data. That is, if the algorithm includes n ^ 1 sequential 
operations as described above in ttie previous example, then each of the master 
processor 12 and the coprocessors 14 saqoantiaily perform all n 4- 1 operations on 
respective sets of the raw data. Consequently, for a given clock frequency, this 

5 parailei-processing technique, like the above-described pipeline technique, can 
increase the speed at which the machine 10 processes the raw data by a factor of 
approximately n 1 as compared to a single-proGessor machine (not shown in FIG, 
1). 

[13] Unfortunately, although the computing machine 10 can process data 

10 more quickly than a single-processor computer machine (not shown in FIG* 1), the 
data^processing speed of the machine 10 is often signfficantiy less than the 
frequency of the processor clock SpecKlcaify, the data-processing speed of the 
computing machine 10 is limited by the time that the master processor 12 and 
coprocessors 14 require to process data. For brevity, an example of this speed 

15 limitation is discussed in conjunction with the master processor 12, although it is 
understood that this discussion also applies to the coprocessors 14. As dSscussed 
above, the master processor 12 executes a program that controls the processor to 
manipulate data in a desSred manner. This program hcludes a sequence of 
instructions that the processor 12 executes, Unfortunateiy> the processor 12 

20 typically requires muftiple clock cycies to execute a single mstruction, and often must 
execute multiple instructions to process a single value of data. For example, 
suppose that the processor 12 is to multiply a first data value A (not shown) by a 
second data value B {not shown). During a first clock cycle» the processor 12 
retrieves a multiply instnjction from the memory 22, During second and third dock 

26 cycles, the processor 12 respectively retrieves A and B from the memory 26. During 
a fourth clock cycle, the processor 12 multiplies A and B, and, during a fifth clock 
cycle, stores the resulting product in the memory 22 or 26 or pmvides the resulting 
product to the remote device (not shown)* This is a best-case scenario, because in 
many cases the processor 12 requires additio na! clock cycles for overhead tasks 

30 such as initializing and closing counters* Therefore, at best the processor 12 
requires five clock cycies, or an average of 2,S clock cycies per data value, to 
process A and B.. 
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[143 Consequently, the speed at which the computing machine 10 

processes data is often significantly lower than the frequency of the clock that drives 
the master proc^sor 12 and ^e coprocessors 14. For example, if the processor 12 
is docked at 1.0 Gigahertz (GHz) but requires an average of 2.5 dock cycles per 
data value, then the effective data-pnocessing speed equals (1 .0 GHz)/2.5 = 0.4 
GHz. This effective data-processing speed is often characterized in units of 
operations per second. Therefore, in this example, for a clock speed of 1 .0 GHz, the 
processor 12 would be rated with a data-processing speed of 0.4 
Gigaoperations/second (Gops). 

£1 5] FIG. 2 is a biock diagram of a hardwired data pipeline 30 that can 

typically process data faster than a processor can for a given clock frequency, and 
often at substantially the same rate at which the pipeline is docked. The pipeline 30 
indudes operator drcuife 32f - 32»,which each perform a respective operation on 
respedive data without executing program instructions. That is, the desired 
operation is "twrned in" to a circuit 32 such that it implements the operation 
automatically, without the need of program instructions. By eliminating the overhead 
associated with executing program instructions, the pipeline W can typically perform 
more operations per second than a processor can for a given clock frequency. 

[16] For example, the pipeline 30 can often solve the foilow'ng equation 

faster than a processor can for a given dock Irequency; 

Y(xt,) = (5Xk + 3)2* 

where represents a sequence of raw data values. In this example, the operator 
circuit 32f is a multiplier that calculates Sxk, the circuit 322 is an adder that calculates 
5xk + 3, and the circuit 32„ (n - 3) is a multiplier that calculates {5Xk + 3)2**-. 

[173 During a first dock cycle k=1 , the drcuit 32i receives data value xt and 

multiplies it by 5 to generate Sx-j. 

[183 During a second dock cyde k - 2, the circuit 32z receives 5xi from the 

circuit 32i and adds 3 to generate 5xi + 3. Also, during the second dock cyde, the 
circuit 32i generates 6x2. 

During a third dock cyde k - 3. tiie drcuit 323 receives 5xi + 3 from 
the circuit 32^ and multiplies by 2^^{effectrvely left shifts 5xi + 3 by x^) to generate 

6 
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the first resuit (5xi ^ 3)2^^ Also during the third clock cycSe, the drcult 32^ generates 
5X3 and the circuit 322 generates 5X2 + 3, 

120] The pipaflne 30 continues processing subsequent raw data values Xk in 

this manner until all the raw data values are processed< 

5 [21 } Consequently, a deiay of two clock cycles after receiving a raw data 

value xi — this delay is often called the latency of ttie pipeline 30 — the pipeline 
generates the resuit (5xi ^ 3)2^\ and thereafter generates one result — e.g., (5X2 ^ 
3)2"^, (5X3 3)2^^, . . 5Kn ^ 3)2^ ~ each dock cycle. 

[22J Disregarding the latency, the pipeiine 30 thus has a data-processing 

10 Speed equal to the clock speed. In comparison, assuming that the master processor 
12 and coprocessors 14 (FIG. 1) have data-processing speeds that are 0.4 times the 
clock speed as in the above example, the pipeline 30 can process data 2,5 times 
faster than the computing machine 10 (FIG, 1) for a given clock speed, 

[233 Stili referring to FIG, 2, a designer may choose to implement the 

15 pipeline 30 in a programmable logic iC (PLiC), such as a field-programmabie gate 
array {FPGA), because a PLIC allows more design and modification flexibility than 

does an appHcatfon specific IC (AS1C)> To configure the hardwired connections 
within a PL{C> the designer merely sets interconnection -configuration registers 
disposed within the PLiC to predetarmined binary states^ The combination of all 

20 these binary states is often catied ^firmware." Typically, the designer loads this 

firmware into a nonvolatile memory (not shown in FIG* 2) that is coupled to the PLIC. 
When one lurns on" the PLfC, it downloads the firmware from the memory Into the 
interconnection-configuration registers. Therefore, to modify the functioning of itie 
PLIC, the designer merely modifies the firmware and allows the PLIC to download 

25 the modified firmware into the interconnedtion-configuration registers. This ability to 
modify the PLIC by merely modifying the firmware is particularly useful during the 
prototyping stage and for upgrading the pipefine 30 "in the ffeld^ 

[243 Unfortunately, the hardwired pipeline 30 may not be the best choice to 

execute aigorithms that entail significant decision making, pa rtlculariy nested 
30 decision making, A processor can typioaliy execute a nested-decision-making 

instruction {e.g., a nested conditional instruction such as If A, then do B, else if C, 
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do D, , , e!se do n") approximately as fast as tt can execute an operational 
instruction (e.g., ''A * B") of comparable iength. But although the pipeHna 30 may be 
able to make a refatfvely simple decision (e.g., ^'A > B?") efficientiy, it typically cannot 
execute a nested decision (e.g., "if A, then do B, else if C, do D, , , else do rf) as 
5 efficiently as a processor can. One reason for this inefficiency is that the pipeline 30 
may have Sittle on-board memory, and thus may need to access externa! 
WDrking/instruction memory (not shown). And although one may be able to design 
the pipeline 30 to execute such a nested decision, the size and comptexity of the 
required circuitry often makes such a design impractical, particujarly where an 
10 algorithm includes multiple different nested decisions, 

|253 Consequently, processors are typical !y used in applications that 

require significant decision making, and hardwired pipelines are typically limited to 
"number crunching" appiicatfons that entail fittle or no decision making. 

[26] Furthermore, as discussed betow, it is typically much easier for one to 

15 design/modify a processor-based computing machine, such as the computing 

machine 10 of FIG. 1 , than it is to design/modify a hardwired pipeline such as the 
pipeline 30 of FIG* 2, particularly where the pipeline 30 Indudes multiple PLiCs, 

[27| Compufing components, such as processors and their peripherals 

(e.g., memory), typically include industry-standand communication interfaces that 
20 facilitate the interconnection of the components to form a processor-based 
computing machine, 

, [28] Typically, a standard communication interface includes two layers: a 

physica! layer and a services layer. 

[29| The physical layer includes the circuitry and the corresponding clrcuk 

25 interconnections that form the interface and the operating parameters of this 
circuitry. For example, the physical layer includes the pins that connect the 
component to a bus, the buffers that fetch data received from tiie pins, and the 
drivers that drive signafs onto the pins. The operating parameters include the 
acceptable voltage range of the data signals that the pins receive, the signal timing 
30 for writing and reading data, and the supported modes of operation (e.g., burst 
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mode» page mode). Conventional physical layers include transistor-transistor togic 
(TTL) and RAMBUS. 

[30] The services layBr inciudes the protocol by which a computing 

component transfers data. The protocol defines the format of the data and the 
5 manner in which the component sends and receives the formatted data. 

Gonventlonai commynication protocols indude file-transfer protocol (FTP) and 
transmission control protocof/internet protocol (TCP/jP)> 

[313 Consequently, because manufacturers and others typically design 

computing components having industry-standard communicatton interlaces, one can 
1 0 typicaily design the interface of such a component and interconnect it to other 

computing components with relatively iittle effort. This afiows one to devote most of 
his time to designing the other portions of the computing machine, and to easily 
modify the machine by adding or removing components. 

[32] Designing a cx>mputtng component that supports an industry-standard 

1 5 communication interface allows one to save design time by using an existing 

physioai*layer design from a design fibrary. This also insures that h^she can easily 
interface the component to off-the-shelf computing components. 

[33] And designing a computing machine using oomputing components that 

support a common industry-standard communicatbn interface allows the designer to 

20 interconnect the components with iittSe time and effort. Because the components 
support a common interface, the designer can interconnect them via a system bus 
with little design effort. And because the supported interface is an industry standard, 
one can aasNy modify the machine. For example, one can add different components 
and peripherals to the machine as the system design evolves, or can easily 

25 add/design next-generation components as the technology evolves. Furthermore, 
because the components support a common industry-standard service layer, one 
can incorporate into the computing machine's software an existing software module 
that implements the corresponding protocol. Therefore, one can Interface the 
components with iittie effort because the interface design is essentially already In 

30 piace> and thus can focus on designing the portions {e.g., software) of the machine 
that cause the machine to perform the desired function(s). 
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[34| But unfortunately, there are no known Industry-standard services 

iayers for components, such as PLICs, used to form hardwired pfpeiines such as 
the pipeline 30 of FIG. 2. 

[351 Consequentiy, to design a pipeyne having muitiple PLlCs, one typically 

5 spends a Sfgnificant amount of time and exerts a significant effort designing and 
debugging the services layer of the comnnunicatlon interface between the PLICs 
"from scratch/ Typically, such an ad hoc services layer depends on the parameters 
of the data being transferred between the PLICs, Likewise, to design a pipeline that 
interfaces to a processor, one wouid have to spend a significant amount of time and 
1 0 exert a significant effort in designing and debugging the services layer of the 
Gommunicatton interface between the pipeime and the processor from scratch. 

£36] Simiiariy, to modify such a pipeline by adding a PLIC to it, one typicatly 

spends a significant amount of time and exerts a slgnfffcant effort designing and 
debugging the services layer of the communication interface between the added 
15 PLIC and the existing PLiCs* Likewise, to modify a pipefine by adding a processor, 
or to modify a computing machine by adding a pipeline, one would have to spend a 
significant amount of time and exert a significant effort in designing and debugging 
the sen/ices layer of the commynlcation interface between the pipeiine and 
processor 

20 [37] Consequently, referring to FIGS. 1 and 2, because of the difficulties in 

interfacing multiple PLICs and in tnterfacing a processor to a pipeline, one is often 
forced to make significant tradeoffs when designing a computing machine. For 
example, with a processor-based computing machine, one is forced to trade 
number-crunching speed and design/mod Sfbatbn flexibility for compfex decision- 

25 making ability. Conversely, with a hardwired pipefine-based computing machine, 
one is forced to trade complex-decislon-making ability and design/modiication 
flexibility for number-crunching speed. Furthermore, because of the difficulties in 
interfacing multipie PLiCs, it is often impractical for one to design a pipeline-based 
machine having more than a few PLiCs. As a result, a practical pipeline-based 

30 machine often has iimited functionality. And because of the difficulties in interfacing 
a processor to a PLiC, it would be Impractical to interface a processor to more than 



9 



wo 20iN/<>42562 



FCr/US2WM)3455ii 



one PLiC, As a result, the benefits obtained by combining a processor and a 
pipeHne would be minima!, 

[38] Therefore, a need has arisen for a new compyting architecture that 

allows one to combine the decision-making ability of a processor-based machine 
5 with the number-crunching speed of a hardwired-pipeiine-based machine, 

[393 According to an embodiment of the invention, a pipeline aoceierator 

indudes a memory and a hardwired-pipeiine drcuit coupled to the memory* The 
hardwired-pipeilna circyit Is operable to receive data, load the data into the memory, 
10 retrieve the data from the memory, process the retrieved data, and provide the 
processed data to an external source, 

|403 According to another embodiment of the invention, the 

hardwired-pipeline circuit is operable to recaive data, process the received data, 
load the processed data into the memory, retrieve the processed data from the 
1 5 memory, and provide the retrieved processed data to an external source. 

£41] Where the pipetine accelerator is coupled to a processor as part of a 

peer-vector machine, the memoty faciiitates the transfer of data — whether 
unidirectional or bidirectionaf — between the hardwired-pipeline circuit and an 
appflcatlon that the processor executes, 

20 BRIEF Description of the Drawings 

[42] FIG. 1 is a block diagram of a computing machine having a 

conventional muIti*processor architecture, 

[433 FIG- 2 is a block diagram of a conventional handwlred pipeline. 

{44] FIG. 3 is a block diagram of a computing machine having a peer-vector 

25 architecture according to an embodiment of the inventjon, 

145] FIG. 4 is a b!oGk diagram of the pipeline accelerator of FIG. 3 

according to an embodiment of the invention, 

[46| FIG. 5 is a block diagram of the handvvired*pipeiine circuit and the data 

memory of FIG, 4 according to an embodiment of the invention> 
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|473 FIG. 6 is a block diagram of the memory-write interfaces of the 

communication shell of FIG. 5 according to an embodiment of the invention. 

f48I FIG. 7 IS a block diagram of the memory«read Interfaces of the 

communication shell of FIGx S according to an embodiment of the invention. 

5 [49] FIG* 8 is a block diagram of the pipeline acceierator of FIG, 3 

according to another embodiment of the Invention. 

[50] FIG. 9 is a block diagram of the hardwired-pipeline circuit and the data 

memory of FiG- S according to an embodiment of the invention, 

DET^LED DESCRfPTION 

1 0 [51| FIG. 3 is a schematic biock diagram of a computing machine 40, which 

has a peer-vector architecture according to an embodiment of the invention, in 
addition to a host processor 42, the paar-vector machine 40 includes a pipeline 
accelerator 44, which performs at least a portion of the data processing, and which 
thus elfectiveiy replaces the bank of coprocessors 14 in the computing machine 10 

15 of FIG, 1 , Therefore, the host-processor 42 and the acceierator 44 (or units thereof 
as discussed below) are ''peers" that can transfer data vectors back and forth. 
Because the accelerator 44 does not execute program instaidions, it typically 
performs mathematlcaiiy intensive operations on data signifioanfly faster than a bank 
of coprocessors can for a given clock frequency. Consequently, by combining the 

20 decision-making ability of the processor 42 and the number-cnLinching ability of the 
acceierator 44, the machine 40 has ihe same abiiities as, but can often process data 
faster than, a conventiona! computing machine such as the machine 10. 
Furthermore, as discussed below, providing the accelerator 44 with a 
commynication interface that is compatible with the communication interface of the 

25 host processor 42 faciHtates the design and modification of the machine 40, 

particuiady where the processor's communication interface is an industry standard. 
And where the accelerator 44 inciudes muJtiple pipeSine units (e.g., PLiC-based 
circuits), providing each of these units with the same Gommunicetion interface 
facilitates the design and modification of the acceierator, particuiariy where the 

30 communication interfaces are compatible with an industry-standard interface. 

11 
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Moreover, the machine 40 may afso provide other advantages as described below 
and in the previously cited patent applications. 

[521 Sti!! referring to FiG, 3, in addition to the host processor 42 and the 

pipeline acceierator 44, the peer-vector com py ting machine 40 mcludes a processor 
5 memory 46, an Interface memory 48, a bus 50, a firmware memory 52, an optional 
raw-data input port 54, a processed-data output port 58, and an optJona! router 61. 

[53] The host processor 42 includes a processing unit 62 and a message 

handler 64, and the processor memory 46 inoiudes a processing-unit memory 66 
and a handier memory 68, which respectively serve as both program and working 
10 memories for the processor unit and the message handlerv The processor memory 
46 also inciudes an acceSerator-configy ration registry 70 and a 
message-conigu ration registry 72, which store respective configuration data that 
allow the host processor 42 to configure the functioning of the accelerator 44 and the 
format of the messages that the message handier 64 sends and receives. 

1 5 [54] The pipeline accelerator 44 is disposed on at least one PLIC (not 

shown) and includes hardwired pipelines 74i - 74m which process respective data 
without executing program instructions The firmware memory S2 stores the 
configuration firmware for the accelerator 44. if the accelerator 44 is disposed on 
multiple PLlCs, these PLlCs and their respective firmware memories may be 

20 disposed in myltipie pipeline units (F!G. 4). The accelerator 44 and pipeline units 
are discussed further below and in previously cited U.S, Patent App, Serial No. 
10/683,932 entitled PIPELfNE ACCELERATOR HAVING MULTIPLE PfPELINE 
UNITS AND RELATED COMPUTiNG MACHiNE AND yETHOD. Alternativefy, the 
acceierator 44 may be disposed on at least one ASIC, and thus may have Internal 

25 Interconnections that are unoonfigurabie. In this alternattve, the machine 40 may 
omit the fimnware memory 52. Furthermore, although the accelerator 44 is shown 
including muitiple pipefines 74, It may include oniy a single pipeline. In addition, 
although not shown, the accelerator 44 may Include one or more processors such as 
a digital-signal processor (DSP). Moreover, although not shown, the accelerator 44 

30 may include a data input port and/or a data output port, 

[55] The general operation of the peer-vector machine 40 is discussed in 

previously cited US. Patent App, Seriai Mo, 10/684,102 entitled IMPROVED 
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COMPUTING ARCHiTECTURE AND RELATED SYSTEM AND METHOD, and the 
Structure and operation of the pipeline accelerator 44 is discussed beiow in 
CDnJunction with FIGS, 4 - 9> 

[563 4 is a schematic biock diagram of the pipeline accelerator 44 of 

FIG. 3 according to an embodiment of the invention, 

J57| The aocelerator 44 mciudes one or more pipeline units 78, each of 

which includes a pipeline circuit BO, such as a PLIC or an ASIC, As discussed 
further below and in previously cited U.S, Patent App, Serial No. 10/683,932 entitled 
PIPELINE ACCELERATOR HAVING MULTIPLE PIPELINE UNITS AND RELATED 
COMPUTING MACHINE AND METHOD, each pipeline unit 78 is a "peer" of the host 
processor 42 and of the other pipeline units of the accelerator 44. That is, each 
pipeline unit 7B can communicate directly with the host processor 42 or with any 
other pipeline unit Thus, this peer-vector architeciure prevents data "bottlenecks*' 
that otherviise might occur If afl of the pipeline units 78 communicated through a 
centra! focatfon such as a master pipefine unit (not shown) or the host processor 42. 
Furthermore, it allows one to add or remove peers from the peer-vector machine 40 
(FIG* 3) without aignificant modifications to the machine. 

fSS] The pipeline circuit BO indudes a communication interface 82, which 

transfers data between a peer» such as the host processor 42 (FIG. 3), and the 
following other components of the pipeline circuit: the hardwired pipelines 74i-74n 
(FIG. 3) via a communication shell B4, a controifer 86, an exception manager 88, 
and a configuration manager 90. The pipeline circuit 80 may also include an 
industry-standard bus interface 9?. Atternatively, the functional Ity of the interface 91 
may be included within the communication interface 82. 

159] By designing the components of the pipeline circuit BO as separate 

modules, one can often simplify the design of the pipeline circuit That is, one can 
design and test each of these components separately, and then integrate tham 
much fiice one does when designing software or a processor^based computing 
system (such as the system fO of FIG. 1), in addition, one can save m a library (not 
shown) hardware description language (HDL) that defines these components — 
particularly components, such as the communication interface 82, that \vili probably 
be used frequently in other pipeline designs — thus reducing the design and test 

13 
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tima of future pipefine designs that use the same components. That is, by using the 
HDL from the library, the designer need not redesign previously implemented 
components trom scratch", and thus can focus his efforts on the design of 
components that were not previously impfemented, or on the modification of 
5 previousfy implemented components. Moreover, one can save in the Sibrary HDL 
that defines multipie versions of the pipeline circuit 80 or of the entire pipeline 
acceferatDr 44, so that one can pick and choose among existing designs, 

|603 The communication interface 82 sends and receives data in a format 

recognized by the message handier 64 (FIG. 3), and thus typically facilitates the 

10 design and modification of the peer-vector machine 40 (FIG. 3). For example, if the 
data format is an industry standard such as the Rapid I/O format, then one need not 
design a custom interface between the host processor 42 and the accelerator 44. 
Furthermore, by afiowing the pipeline circuit 80 to communicate with other peers, 
such as the host processor 42 (FIG* 3), via the pipeline bus 50 instead of via a 

15 non-bus interface, one can change the number of pipeHne units 78 by merely 

connecting or disconnecting them (or the drcuit cards that hold them) to the pipeline 
bus instead of redesigning a non-bus interfaGe from scratch each time a pipeline unit 
is added or removed, 

[61] The hardwired pipelines 74i-74n perform respective operations on data 

20 as discussed above in conjunction with FIG. 3 and in previously cited U.S. Patent 
App. Serial No. 10/684,102 entitled IMPROVED COMPUTiNG ARCHfTECTURE 
AND RELATED SYSTEM AND METHOD, and the communication shell 84 
interfaces the pipelines to the other components of the pipeline drcuit 80 and to 
circuits (such as a data memory 92 discussed below) external to the pipeline drcuit 

25 [62] The controller 86 synchronizes the hardwired pipelines 74iJ4n and 

monitors and controls the sequence in which they perform the respective data 
operations in response to communications, Le., '^events," from other peers> For 
example, a peer such as the host processor 42 may send an event to the pipeline 
unit 78 via the pipeline bus 50 to indicate that the peer has finished sending a block 

30 of data to the pipeline unit and to cause the hardwired pipelines 74iJ4n to begin 
processing this data. An event that includes data is typicaily called a message, and 
an event that does not include data is typically called a *'door bell" Furthemiore, as 
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discussed below in conjunction with FIG. 5, the pipeline unit 78 may also 
synchronize the pipelines 74iJ4n in response to a synchronization signal 

[63] The exception manager B8 monitors the status of the hardwired 

pipelines 74i-74n> the communication intorfece 82, the communfcation she!! S4, the 
5 controller B6, and the bus interface Qi, and reports exceptions to the host prx>cessor 
42 (FIG* 3), For exampfe, if a buffer m the communication mterface 82 overflows, 
then the exception manager 88 reports this to the host processor 42> The exception 
manager may also correct, or attempt to correct the problem giving rise to the 
exception. For example, for an overflowing buffer, the exception manager 88 may 
10 increase the size of the butfer. either directly or via the configuration manager 90 as 
discussed beiow. 

[S4] The configuration manager 90 sets the soft configuration of the 

hardwired pipelines 74^74^ the Gommunication interface B2, the communication 
shell 84, the controHer 86, the exception manager 88. and the Interface 9f in 

15 response to soft-configuration data from the host processor 42 (FIG. 3) ~ as 
discussed in previously cited U.S- Patent App. Serial No, 10/684,102 entitled 
IMPROVED COMPUTiNG ARCHiTECTURE AND RELATED SYSTEM AND 
METHOD, the hard configuration denotes the actual topology, on the transistor and 
circuit-block level, of the pipeline circuit 80, and the soft configuration denotes the 

20 physical parameteiis {e.g., data width, table size) of the hard-configured 

components* That is, soft configuration data is similar to the data that can be ioaded 
into a register of a processor (not shown in FIG, 4) to set the operating mode {e.g., 
burst-memory mode) of the processor For example, the host processor 42 may 
send soft-configuration data that causes the configuration manager 90 to set the 

25 number and respective priority levels of queues In the communication interface 82. 
The exception manager 88 may also send soft-configuration data that causes the 
configuration manager 90 to, e.g., increase the size of an overflowing buffer in the 
communication interface 82, 

165] Still referring to FJG, 4, in addition to the pipeline circuit 80, the pipeline 

30 unit 78 of the accelerator 44 includes the data memory 92, an optional 

communication bus 94, and, if the pipeline circuit is a PLIC, the flmiware memory 52 
(FIG, 3), 
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[663 The data memory 92 buffers data as jt flows between another peer, 

^ch as the host processor 42 (FIG. 3), and the hardwired pipeline 74fT4a. and is 
also a working memory for the hardwired pipelines. The communication Interface 82 
interfaces the data memory 92 to the pipeHne bus SO (via the communication bus 94 
and industry-standard interface 91 if present), and the communication sheil 84 
interfaces the data memory to the hardwired pipelines 74i~74a. 

|67| The industry-standard interface 91 is a conventional bus-interface 

circuit that reduces the size and complexity of tiie communication interface B2 by 
effectively offloading some of the interface cincuftry from the communication 
Interface, Therefore, if one wishes to change the parameters of the pipeline bus 50 
or router 61 (FIG. 3), then he need only modify the interface 91 and not «ie 
communication Interface 82. Alternatively, one may dispose the interlace 91 in an 
IC (not shown) that is external to the pipeline circuit BO. Offloading the interface 91 
from the pipeline circuit 80 frees up resources on the pipeline circuit for use in, e.g., 
the hardwired pipelines 74i-74„ and »ie controller 50. Or, as discussed above, the 
bus interface 91 may be part of the communication interface S2. 

[683 As discussed above In conjunction vAdth FIG. 3. where t^e pipeline 

circuit 80 is a PLiC, the finnware memory 52 stores the firmware that sets the hard 
configuration of the pipeline circuit. The menrrary 52 loads the firmware Into the 
pipeline circuit 80 during the configuration of the accelerator 44, and may receive 
modified fimiware from ttie host processor 42 (FIG. 3) via tiie communication 
irrterface 82 during or after flie configuration of the accelerator. The loading and 
receiving of finnware is further discussed in previously cited U.S. Patent App. Serial 
No. 10/684,057 entitled PROGRAMMABLE CIRCUIT AND RELATED COMPUTING 
MACHINE AND METHOD. 

[693 Still referring to FIG. 4, the pipeline circuit 80, data memory 92, and 

finnware memory 52 may be disposed on a circuit board or card 98, which may be 
plugged into a pipeline-bus connector (not shown) much like a daughter card can be 
plugged Into a slot of a mother board in a personal computer (not shown). Although 
not shown, conventtonal ICs and components such as a power regulator and a 
power sequencer may also be disposed on the card 98 as is known. 
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f7Q} Further details of ttie sfructure and operation of the pipeline unit 78 are 

discussed below in conjunction vwth FIG. 5. 

[71] FIG. S Is a bloci< diagram of the ptpeHne unit 78 of FIG. 4 according to 

an embodiment of the invention. For clarity, the firmware memory 52 is omitted from 
FIG. 5, The ptpeitne circuit SO receives a master CLOCK signal, which drives the 
below-described components of the pipeline circuit either directly or Indirectly. The 
pipeline circuit 80 may generate one or more slave ciock signals (not shown) from 
the master CLOCK signal in a conventional manner. The pipeline circuit BO may 
also a receive a s>nnchronization signal SYNC as discussed betow. 

J72| The data memory 92 includes an input duaf-port-statlc-random-access 

memory (DPSRAM) WO, an output DPSRAM 102, and an optional working 
DPSRAM 104, 

[73] The input DPSRAM 100 includes an input port f 06 for receiving data 

from a peer, such as the host processor 42 (FIG. 3), via the communication interface 
B2, and includes an output port 10B for providing this data to the hardwired pipelines 
74ir74n via the communication shell 84. Having two porte, one for data input and 
one for data output, Increases the speed and efficiency of data transfer to/from the 
DPSRAM f 00 because the communication Interface 82 can write data to the 
DPSRAM while the pipelines 74^-74^ read data from the DPSRAM. Furthermore, as 
discussed above, using the DPSRAM fOO to buffer data from a peer such as the 
host processor 42 allows tf?e peer and the pipelines 74i~74n to operate 
asynchronously relative to one and other. That is, the peer can send data to the 
pipelines 74i-74„ without 'Vvaittng" for the pipelines to complete a current operation. 
Likewise, the pipelines 74f-74„ can retrieve data without "waiting" for the peer to 
complete a data-sending operation. 

r74] Similarly, the output DPSRAM f 02 includes an port 110 for 

receiving data from the hardwired pipelines 74r74» via the communication shell 84. 
and includes an output port 112 fox providing this data to a peer, such as the host 
processor 42 (FIG, 3), via the communication Interface 82. As discussed above, the 
two data ports 110 (input) and 112 (output) increase the speed and efTfciency of data 
transfer to/from the DPSRAM f02, and using the DPSRAM f 02 to buffer data from 
tie pipelines 74t-74n allows the peer and the pipelines to operate asynchronously 
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relative to one another* That Is, the pipe!ines 74^-74^ can publish data to the peer 
without 'Waiting^ for the outputHjata handler f 26 to complete a data transfer to the 
peer or to another peer. Likewise, the output-data handier f 26 can transfer data to a 
peer without "waiting"' for the pipelines 74^74^ to cDmplete a data-publishing 
5 operation, 

[753 The working DPSRAM f 04 inciudes an input port 114 for receiving 

data from the hardwimd pipelines 74i-74n via the communication shelf 84, and 
includes an output port f fSfor returning this data back to the pipelines via the 
communtcation shel!. While processing input date received from the DPSRAM 100, 

10 the pjpeilnes 74i-74n may need to temporarily store partially processed, Aa, 

intenmediate, data before continuing the processing of this data. For exampie, a fir^t 
pipeline, such as the pipeline 74i, may generate intemrtediate data for further 
processing by a second pipeiine, such as the pipeline 742. thus, the first pipeline 
may need to temporarily store the intermediate data until the second pipeiine 

15 retrieves it The working DPSRAM 104 provides this temporary storage. As 

discussed above, the two data ports 114 (input) and 116 (output) increase the speed 
and efficiency of data transfer between the pipelines 74^-74^ and the DPSRAM 104. 
Furthermore, iocfyding a separate working DPSRAM f 04 typicaSly increases the 
speed and efficiency of the pipefina circuit 80 by aiiowing the DPSRAMs f 00 and 

20 f 02 to function axciusively as data-input and data-output buffem, respectively. But, 
with siight modification to the pipeiine circuit BO, either or both of the DPSRAMS fOO 
and 102 can also be a working memory for the pipelines 74i-74n when the DPSRAiW 
f 04 is omitted, and even when it is present, 

[76] Although the DPSRAMS f 00, 102, and f 04 are described as being 

25 externai to the pipeline circuit 80, one or more of these DPSRAMS, or equivalents 
thereto, may be intemai to the pipeline circuit. 

[77J Stilt referring to FIG* 5, the communication interface 82 includes an 

industry-standard bus adapter 118, an input-data handler 120, input-data and 
Input^event queues f 22 and 124, an output-data handier 126, and output-data and 
30 output^event queues f 28 and 130. Although the queues f 22, 124, 128, and 130 am 
shown as single queues, one or more of these queues may include sub queues (not 
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shown) that allow segregation by, e.g., prionty, of the values stored in the queues or 
of the respective data that these values represent. 

[78] The industry-standard bus adapter 118 includes the physical layer that 

aflows the transfer of data between the pipeline circurt 80 and the pipeiine bus 00 
5 (FIG, 4) via the communication bus 94. Therefore, if one wishes to change the 
parameters of the bus 94, then he need only modrfy the adapter ilB and not the 
entire Gommunication interface 82. Where the industry-standard bus interface 91 is 
omitted from the pipeiine unit 78, , then the adapter 118 may be modified to allow 
the transfer of data directiy between the pipeline bus 50 and the pipeline circuit SO, 
10 In this latter implementation, the modified adapter 118 includes the functionality of 
the bus interface 9?, and one need only modify the adapter 118 if he/she wishes to 
change the parameters of the bus SO. 

[79] The input-data handler f 20 receives data from the indystry-standard 

adapter 118, loads the data into the DPSRAM 100 via the input port 106, and 

15 generates and stores a pointer to the data and a corresponding data identifier in the 
Input-data queue 122. If the data m the payfoad of a message from a peer, such as 
the host processor 42 (FIG. 3), then the input-data handler f20 extracts the data 
from the message before loading the data into the DPSRAM 100. The input-data 
handler 120 includes an interface 132, which writes the data to the input port 106 of 

20 the DPSRAM f 00 and which Is further discussed below in conjunction with FIG. 6, 
Alternatively, the input-data handler f 20 can omit the extraction step and load the 
entire message into the DPSRAiVI f 00. 

JBOJ The input-data handler f 20 also receives events from the 

industry-standard bus adapter 118, and foads the events into the input^event 
25 queue 124. 

[81] Furthermore, the input-data handler f 20 includes a vafidatlon 

manager 134, which determines whether received data or events are intended for 
the pipeiine circuit 80. The validation manager f 34 may make this determination by 
analyzing the header (or a portion thereof) of the message that contains the data or 
30 the event, by anaiyzing the type of dBta or event, or the analyzing the instance 

identification (Le., the hardwired pipeiine r4 for which the data/event Is intended) of 
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the data or event If the input-data handler 120 receives data or an event that is not 
intended for the pipeline circuit 80, then the validation manager 134 prohibits the 
input-data handler from loading the received data/even> Where the peer-vector 
machine 40 includes the router 61 (FIG. 3) such that the pipeiine unit 78 should 
5 receive on!y data/events that are intended for the pipeiine unit, the vaiidation 
manager 134 may also cause the input-date handler f20to send to the host 
procassor 42 (FIG. 3) an exception message that identrfies the exception 
(erroneousiy received data/event) and the peer that caused the exception, 

[82] The oulput-data handier f 26 retrieves processed data from locations of 

10 the DPSRAM 102 pointed to by the output-data queue 128, and sends the 

processed data to one or more peers, such as the host processor 42 (FIG. 3), via 
the Industry-standard bus adapter 118. The output-data handier i26 indudes an 
Interface 130, which reads the processed data from the DPSRAM 102 via the port 
112. The interface f 36 is further discussed below in conjunction with FIG* 7. 

15 [831 The outputrdata handier 126 also retrieves from the output-event 

queue 130 events generated by the pipelines 74i - 74n. and sends the retrieved 
events to one or more peers, such as the host processor 42 (FIG. 3) via the 
industry-standard bus adapter 118. 

[84] Furthermore, the output-data handler 120 includes a subscription 

20 manager 138, whbh indudes a list of peers, such as the host processor 42 (FIG- 3), 
that subscribe to the processed data and to the events; the output-data handier uses 
this fist to send the data/events to the correct peers. If a peer prefers the data/event 
to be the payload of a message, then the output-data handier 126 retrieves the 
network or bus-port address of the peer from the subscription manager 13B, 
25 generates a header that incfudes the address, and generates the message from the 
data/event and the header, 

[85] Although the technique for storing and retrieving data stored in the 

DPSRAMS f 00 and 102 invoives the use of pointers and data identifiers, one may 
modify the input- and output-data handlers 120 and f 26 to implement other 
30 data-management techniques, Conventiona! examples of such data-management 
techniques Include pointers using keys or tokens, input/output control (IOC) bfoci^, 
and spooihig. 
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[86] The communication sh^l 84 Includes a physical layer that tnterfaces 

the hardwired pipelines T4i'74n to the output-data queue 128, the controller 86, and 
the DPSRAMs 100, 102, and 104. The shell 84 Includes Interfaces 140 and 142, 
and optional interfaces f 44 and 146, The interfeces f 40 and 146 may be simiiarto 
the Interface 13$; the Interface 140 reads input data from the DPSRAM 100 via the 
port 108, and the interface 146 reads intermediate data from the DPSRAM 104 via 
the port 116, The interfaces 142 and 144 may be similar to the Interface 132; the 
Interface 142 writes processed data to the DPSRAM 102 via the port 110, and the 
interface 144 writes intermediate data to the DPSRAM 104 via the port 114. 

I87| The confroHer 86 includes a sequence manager 148 and a 

synchronization Interface t50, wdltich receives one or more synchronization signals 
SYNC. A peer, such as the host processor 42 <FIG. 3), or a device (not shown) 
externa! to the peer-vector machine 40 (FIG. 3) may generate the SYNC signal, 
which triggers the sequence manager ?48 to activate the hardwired pipelines 74^ 
74„ as discussed below and In previously cited U.S. Patent App. Serial No. 
10/683,932 entitled PIPELINE ACCELERATOR HAVING MULTIPLE PIPELINE 
UNITS AND RELATED COMPUTING MACHINE AND METHOD. The 
synchronization interface ISO may also generate a SYNC signal to trigger the 
pipeline circuit SO or to trigger another peer. In addition, the events from the 
input-event queue 124 also trigger the sequence manager 148 to activate the 
hardwired pipelines 74i'74n as discussed below, 

[88] The sequence manager f 48 sequences the hardNwred pipelines 74^- 

74„ through their respective operations via the communlcaiSon shell 84. Typically, 
each pipeline 74 has at least three operating states: preprocessing, processing, and 
post processing. During preprocessing, the pipeline 74, e.g.. initializes its registers 
and retrieves input data from the DPSRAM 100, During processing, the pipeline 74, 
e.g.. operates on the retrieved data, temporarily stores intermediate data in the 
DPSRAM 104, retrieves the intermediate data from the DPSRAM 104, and operates 
on the intermediate data to generate result data. During post processing, the 
pipeline 74, e.g., toads the result data into the DPSRAM 102. Therefore, the 
sequence manager 148 monitors the operation of the pipelines 74i-74n and instructs 
each pipeline when to begin each of its operating states. And one may distribute the 
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pipeline tasks among the operating states differently than described above. For 
exampfe, iJie pipeline 74 may retneve input data frcan the DPSRAM iOO during the 
processing state instead of during the preprocessing state. 

£89] Furthermore, the sequence manager 148 maintains a predetermined 

internal operating synchrontzation among the hardwired pipelines 74r74„. For 
example, to avoid all of the pip^ines 741-74^ sln^ultanecaisly retrieving date from the 
DPSRAM f 00, It may be desimd to synchronize the pipelines such that while the first 
pipeline 74i is in a preprocessing state, the second pipeline 74a is in a processing 
state and the third pipeline 743 >s in a post-pnocessing state. Because a state of one 
pipeline 74 may require a different number of clock cydes than a concuirently 
performed state of another pipeline, the pipelines 74r74„may lose synchronization If 
allowed to run freely. Consequently, at certain times there may be a 1>ottle mck," 
as, for example, multiple pipelines 74 simultaneously attempt to retrieve data from 
the DPSRAM iOO. To prevent tiie loss of synchronization and its undesirable 
a3nse<|uences. the sequence manager 14S allows all of the pipelines 74 to complete 
a current operating state before allowing any of the pipelines to proceed to a next 
operating state. Therefore, the time that the sequence manager 148 allots for a 
current operating state is long enough to allow the slowest pipeline 74 to complete 
that state. Alternatively, circuitry {not shown) for maintaining a predetermined 
operating synchronization among the hardwired pipelines 74r74„ may be Included 
within the pipelines themselves. 

190] In addition to sequencing and Internally synchronfeing the hardwired 

pipelines 74f - 74«, the sequence manager 148 synchronizes the operation of the 
pipelines to the operation of other peers, such as the host processor 42 (FIG. 3), and 
to the operation of other external devices in response to one or more SYNC signals 
or to an event In the Input-events queue f 24. 

[91 1 Typically, a SYNC signal triggers a time-critical function but requires 

significant hardware resources; comparatively, an event typically triggers a 
non-time-critical function but requires significantly fewer hafdware resoumes. As 
discussed in prevfously cited U.S. Patent App. Serial No, 10/683,932 entitled 
PIPELINE ACCELERATOR HAVING MULTIPLE PIPELINE UNITS AND RELATED 
COMPUTING MACHINE AND METHOD, because a SYNC signal Is routed directly 
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from peer to peer, It can trigger a function more quickly Itian an event, which must 
makes its way through, e.g., the pipeline bus $0 {PiG. 3), the input-data handler 120, 
and the input-event queue 124, But because they are separateiy routed, the SYNC 
signals require dedicated drcuitry, such as routing lines, buffers, and the SYNC 
interface f 50, of the pipeline circuit 80. Conversely, because they use the existing 
data-transfer infrastructure {e.g. the pipeline bus 50 and the input-data handier 120), 
the events require only the dedicated input-event queue 124. Consequently, 
designers tend to use events to trigger ail but the most time-critical functions. 

The following is an example of functkm triggering. Assume that a 
sonar sensor element {not shown) sends blocks of data to the pipeiine unit 78. the 
input-data handier 120 stores this data in the DPSRAM 100, ttie pipeiine 74i 
transfers this data from the DPSRAM 100 io the DPSRAM 104, and, when triggered, 
the pipeiine 742 retrieves and processes the data from the DPSRAM 104. if the 
processing *iat the pipeline 74^ perfomrjs on the data is time critical, then the sensor 
elennent may generate a SYNC pulse to trigger the pipeline 742, via the interface 150 
and the sequence manager 14S, as soon as the pipeline 74i finishes loading an 
entire bloci< of data into the DPSRAM f 04. There are many conventional techniques 
that the pipeline unit ZSand the sensor can employ to determine when the pipeline 
74i Is finished. For example, as discussed below, the sequence manager 148 may 
provide a corresponding SYNC pulse or event to the sensor. Alternatively, if the 
processing that the pipeline 74^ performs Is not time critical, then the sensor may 
send an event to tie sequence manager 148 via the pipeiine bus 50 (FIG. 3), 

[933 The sequence manager 148 may also provide to a peer, such as the 

host processor 42 (FIG. 3), infomnatjon regarding the operation of the hardwired 
pipelines 74f74„ by generating a SYNC pulse or an event The sequence manager 
148 sends a SYNC pulse via the SYNC InteriBce f 50 and a dedicated fine (not 
shown), and sends an event via the output-event queue f 30 and the output-data 
handler f20. Referring to the above example, suppose that a peer further processes 
the data blocks from the pipeiine 742. The sequence manager 148 may notify the 
peer via a SYNC pulse or an event when the pipeline 742 has finished processing a 
block of data. The sequence manager 148 may also confirm receipt of a SYNC 
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pulse or an event by generating and sending a corresponding SYNC pulse or event 
to the apprapriate peer(s), 

{94] StII! referring to FIG. 5> the operation of the pipeline unit 78 is 

discussed according to an embodiment of the Invention. 

£953 For data, the tndusfry-standard bus interface 91 receives date s^nals 

(wrfiich originates from a peer, such as the host processor 42 of FIG, 3) ixom the 
pipeline bus 50 (and the router 61 rf present), and translates these signals Into 
messages ^ch having a header and payload. 

[96] Next, the industry-standard bus adapter IIS converts the messages 

from the industry-standard bus interface 91 into a format that is compatible with the 
input-data handler 120. 

[97| Then, the input-data handler 120 dissects the message headere and 

extracts fn3m each header the portion that descrfbes the data payioad. For example, 
the extracted header portion may indude, e.g., the address of the pipeline unit 78, 
the type of data In the payJoad, or an instance identifier that Identifies the pipeline{s) 
7Bi - 7Bn for which the data is intended. 

[981 Next, the validation manager f 34 analyzes the extracted header 

portion and confirms that the data is intended for one of the hardwired pipelines 74r 
74n, the interface 132 writes the data to a location of the DPSRAM 100 via the port 
10Q, and the Input-data handler 120 stores a pointer to the location and a 
con-esponding data Identifier In IJie Input-data queue 122. The data identifier 
identifies the pipeline or pipelines 74r74. for which the data Is intended, or includes 
information tiiat allows the sequence manager 148 to make this identffication as 
discussed below. Alternatively, the queue 122 may include a respective subqueue 
{not shown) for each pipeline 74-{~74n, and the Input-data handler 120 stores the 
pointer In the subqueue or subqueues of the intended pipeline or pipelines. In this 
alternative, the data identifier may be omitted. Furthermore, if the data is the 
payload of a message, then the input-data handler 129 extracts the data from the 
message before the interface 132 stores the data in the DPSiRAM 100, 
Alternatively, as discussed above, me interface 132 may store the entire message in 
the DPSRAy 100. 
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[991 Then, at the appropriate time, ihe sequence mar^ger 148 reads &ie 

pointer and the data identifier from the Input-data queue 122, detemnines from the 
data identjfier the pipeiine or pipelines 74i - 74» for which the data Is Intended, and 
passes the pointer to the pipeline or pipelines via the communication shell 84. 

JlOOj Next, the data-receiving pipeline or pipelines 74i - 74„ cause the 

interface 140 to retrieve the data from the pointed-to location of tiie DPSRAM 100 
via the port 108. 

li Oli Then, the data-receiving pipeline or pipelines 74i''74„ process the 

retrieved data, the Interface 142 writes the processed data to a location of the 
DPSRAM 102 via the port 110, and the communication shell 84 loads into the 
output-data queue 128 a pointer to and a data identifier for the processed data. The 
data identifier identifies the destination peer or peers, such as the host processor 42 
(FIG, 3), that subscribe to the processed data, or includes information (such as the 
data type) that allows the subscription manager 1S8 to subsequently detemiins the 
destination peer or peers (e.g., the host pnDcessor 42 of FIG, 3). Alternatively, the 
queue 128 may in dude a respective subqueue {not shown) for each pipeline 74?- 
74„, and the communication shell 84 stores the pointer in the subqueue or 
subqueues of the originating pipeline or pipelines. In this alternative, ihe 
communication shell 84 may omit loading a data Identifier Into the queue 128. 
Furthermore, if the pipeline or pipelines 74r74„ generate Intermediate data while 
processing the retrieved data, then the Interface f 44 writes the Intermediate data 
into the DPSRAM 104 via the port 114, and the interface 146 retrieves the 
intermediate data from the DPSRAM 104 via the port 116. 

[102] Next, the output-data handier 126 retrieves the pointer and the data 

identifier from the output-data queue 128, the subscription manager 138 determines 
from the identifier the destination peer or peers (e.g., the host processor 42 of FIG, 
3) of the data, the interface 136 retrieves the data from the pointed-to location of the 
DPSRAM 102 via the port 112, and the output-data handler sends the data to the 
industr>'-standard bus adapter 118. if a destination peer requires the data to be the 
payload of a message, then the output-data handler 126 generates the message 
and sends the message to the adapter 11B. For example, suppose the data has 
multiple destination peers and the pipeline bus 50 supports message broadcasting. 

2S 
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The output-data handler f 26 generates a single header that tnctudes the addresses 
of at! the destination peers, combines the header and data into a message, and 
sends (via the adapter 118 and the industry-standard bus Interface 91) a single 
message to a!! of the desti nation peers srmultaneous!y> Alternatively, the output* 
5 data handier f 20 generates a respective header, and thus a respective message, for 
each destination peer, and sends eaoh of the messages separately . 

J1033 Then, the industry-standard bus adapter 118 formats the data from the 

output-data handler 12S so that it is compatible with the industry-standard bus 
interface 91. 

10 [1043 Next, the industry-standard bus interface 91 formats the data fronn the 

industry-standard bus adapter 118 so that it is compatibie with the pipeline bus 50 
{Fia. 3). 

^1053 For an event with no accompanying data, /,e-, a doorbati, the 

Industry-standard bus interface 91 receives a signal (which originates from a peer, 
1 5 such as the host processor 42 of FIG, 3) from the pipeline bus SO (and the router 61 
If present), and translates the signal into a header (/.a., a data-less message) that 
includes the event. 

[106j Next, the industry-standard bus adapter 118 converts the header from 

the industry-standard bus interface 91 into a fomiat that is compatible with the 
20 input-data handier 120. 

[107] Then, the input'<lata handler 120 extracts frc^m the header the event 

and a description of the event. For example, the description may include, e,g„ the 
address of the pipeline unit 7B, the type of event, or an instance identifier that 
identifies the pipeline(s) 78i - 78/, for which the event is intended. 

25 [1083 Hext, the vaiidatlon manager 134 analyzes the event description and 

confirms that the event is intended for one of the hardwired pipelines 74i-74ns and 
the input-data handier 120 stores the event and its description in the input-event 
queue 124. 

f1093 Then, at the appropriate time, the sequence manager 148 reads the 

30 event and its description from the Input-event queue 124, and, in response to the 
event, triggers the operation of one or more of the pipelines 74r74n as discussed 
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above. For exampte, the sequence manager 148 may trigger the pipeHne 74^ to 
begin processmg data that the pipeSine 74f previously stored fn the DPSRAM 104. 

i11CJ To output an event, the sequence manager 148 generates the event 

and a description of the event, and loads the event and its descriptfon into the 
output-event queue 130 — the event description identifies the destination peer(s) for 
the event if there is mora than one possibie destination peer For exampte, as 
discussed above, the event may confirm the receipt and impiementation of an input 
event an input-data or input-event message, or a SYNC puise 

n 1 1] Next, the output-data handler 126 retrieves the event and its 

descriptton from the output-^event queue f 30, the subscrlptton manager 1W 
determines from the event desoriptton the destinatjon peer or peers (e.g., the host 
processor 42 of FIG. 3) of the event, and the output-data handler sends the event to 
the proper destination peer or peers via the industry-standard bus adapter 118 and 
the industry-standard bus interface 91 as discussed above, 

[1123 For a configuration command, the industry-standard bus adapter 118 

receives the command from the host processor 42 (FIG, 3) via the industry-standard 
bus interface 91, and provides the command to the input-data handler f 20 in a 
manner similar to that discussed above for a data-less event (7,e., doorbel!) 

|1 13] Next, the vaiidation manager 134 confirms that the command is 

intended for the pipeline unit 78, and the input-data handler 120 loads the command 
into the configuration manager 90, Furthennore, either the Input-data handier 120 or 
the configuration manager 90 may also pass the command to the output-data 
handier 126, which confirms that the pipeline unit 78 received the command by 
sending the command back to the peer (e.g., the host processor 42 of FIG. 3) that 
sent the command. This confirmation technique is sometimes calied "echoing." 

|1 14] Then, the configuration manager 90 implements the command. For 

example, the command may cause the configuration manager 90 to disable one of 
the pipeiines 74r74n for debugging purposes. Or, the command may ailow a peer, 
such as the host processor 42 (FIG. 3), to read the current configuration of the 
pipeifne circuit ao from the configuration manager SO via the output-data handler 
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126. in addition, one may use a configuration command to define an exception that 
is recognized by the exception manager 88. 

[115] For an exception, a component, such as the input-data queue f 22, of 

the pipeline circuit 80 triggers an a)cceptfon to the exception manager SB. In one 
impfementation, the component inclydes an exception-triggering adapter (not 
shown) that monitors the component and triggers the exception in response to a 
predetermined condition or sat of conditions. The exception-triggering adapter may 
be a universal circuit that can be designed once and then included as part of each 
component of the ptpeiine circuit 80 that generates exceptions, 

|116] Next, In response to the exception trigger, the exception manager 88 

generates an exception identifier. For exampie, the identif ier may indicate that the 
input»data queue 122 has overflowed. Furthemiore, the identifier may inciude its 
destination peer if there Is more than one possifoie destination peer. 

|1 17J Then, the outputnjata handler i26 retrieves the exception identifier 

from the exception manager 88 and sends the exception identifier to the host 
processor 42 {FIG. 3) as discussed in previously cited U.S* Patent App. Serial No, 
10/684,053 entitied COMPUTING 1V1ACHINE HAVfNG IMPROVED COMPUTING 
ARCHiTECTURE AND RELATED SYSTEM AND METHOD, Aftemativeiy, If there 
are multiple possible destination peers, then the exception identifier can also include 
destination infomiation from which the subscription manager 138 determines the 
destination peer or pears (e.g., the host processor 42 of FIG, 3) of the identifier. The 
output-data handler 126 then sends the identifier to the destmation peer or peers via 
the industry-standard bus adapter 118 and the industry-standard bus mterface 91. 

[118] StiH refenring to FIG* 5, alternative embodiments to the pipeline unit 78 

exist For example, although described as Including DPSRAMs, the data memory 
92 may include other types of memory ICs such as quad«data-rate (QDR) SRAMs, 

[119] FIG. 6 is a block diagram of the interface 142 of Ff G, 5 according to an 

embodiment of the Invention. As discussed above in conjunction with FIG. 5, the 
interface 142 writes processed data from the hardwired pipeiines 74r74n to the 
DPSRAM 102. As discussed below, the strucfeire of the interface 142 reduces or 
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eHminates data "bottlenecks" and, where the pipeline drcuit 80 (FIG, 5) is a PLIC, 
makes efficient use of the PLfC's focal and global routing resources. 

[1203 The interface 142 includes write channels ISOi ~ 150n, one channel for 

each hardwired pipeline 74i ~ 74^ (FIG. 5), and includes a controlter 152. For 
6 purposes of illustration, the channel 150i is discussed below, it being understood 
that the operation and structure of the other channels ISOg- 150n are stnnilar unless 
stated otherwise. 

[121| The channel ISOi includes a write-address/data FIFO 1S4i and a 

address/data register 15Si. 

10 t122] The FIFO 154i stores the data that the pipeline 74-, writes to the 

DPSRAM 102, and stores the address of the location within the DPSRAM 102 io 
which the pipeline writes the data, until the controller 1S2 can actually write the data 
to the DPSRAM 102 via Sie register f 56^. Therefore, tiie FIFO 1S4i reduces or 
eifnnlnates the data bottJenecl< that may occur if the pipeline 74i had to "waft" to write 

1 5 data to the channel f 50* until the controller f 52 finished writing previous data. 

E123j The FIFO 1S4i receives the data from the pipeline 74i via a bus 158i, 

receives the address of the iocation to which the data is to be written via a bus IQO-i, 
and provides the data and address to the register 15Bi via busses f 62< and 1&4i, 
respectiveiy. Furthermore, the FiFO 154i receives a WRiTE FIFO signal from the 

20 pipeline 74i on a fine 1G6i, receives a CLOCK signal via a line fSSf, and provides a 
FIFO FULL signal to the pipeline 74i on a line ^70^ In addition, the FIFO f54/ 
receives a READ FIFO signal from the controller 152 via a line 172i, and provides a 
FIFO EMPTY signal to the controller via a line 174i, Where the pipeline circuit BO 
(FIG. 5) is a PLIC, the busses 15Bi, 160i, 102i, and 164i and the lines 16Bi, 168i, 

25 ?70f, 172i, and 174i are preferably fonned using local routing resources. Typically, 
local routing resources are preferred to global louting resources because the signal- 
fxaVn lengths are generally shorter and the routing Is easier to implement. 

E124J The register 156i receives the data to be written and the address of 

the write iocation from the FiFO 154i via the busses 162i and 164i, respectively, 
30 and provides the data and address to the port 110 of the DPSRAM 102 (FIG. 5) via 
an address/data bus 176. Furthermore, the register 156i also fBceives the data and 
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address from the registers iSSz- 1S6„ via an address/data bus f 73? as discussed 
below, in addition, register 1S6i receives a SHIFT/LOAD signal from tlie 
controller f 52 via a line 180, Where the pipeline circuit 80 (FIG, 5) is a PLIC, the 
bus f re is typtcaify formed using global routing resources, and the busses f78f - 
178„,i and the line 180 are preferably formed using local routing resources, 

[125] In addition to receiving the FIFO EMPTY signal and generating the 

READ FIFO and SHIFT/LOAD signals, the controller 152 provides a WRITE 
DPSRAiVI signal to the port 110 of «ie DPSRAM W2 (FIG. 5) via a line 182, 

f1261 Still referring to FIG. 6, the operation of the interface 142 is discussed, 

I127j First, the FIFO 154t drives the FIFO FULL signal to the logic level 

corresponding to the current slate {"fuH" or "not fuit") of the FIFO. 

[128| Next, if the FIFO 1S4i is not full and the pipeline V4f has processed 

data to write, the pipeline drives the data and corresponding address onto the 
busses 1S8i and 160i, respectively, and asserts the WRITE signal, thus loading the 
data and address into the FIFO. If the FIFO 1S4i is full, however, the pipeline 74i 
waits until the FIFO is not fui! before loading the data. 

[1293 Then, the FIFO 154i drives the FIFO EMPTY signal to the logic level 

corresponding to the current state fempty" or "not empty") of the FIFO. 

[1 30] Next, if the FIFO 1S4i Is not empty, the controller 152 asserts tie 

READ FIFO signal and drives the SHIFT/LOAD signal to the load logic level, thus 
loading the first loaded data and address from the FIFO Into the register 156i. If the 
FIFO 154i is empty, the controller 152 does not assert READ FIFO, but does drive 
SHIFT load to the load logic level if any of the other FIFOs 154^1S4„ &m not empty. 

[1 31 J The channels I5O2 - 1S0„ operate in a similar manner such that first- 

loaded data in the FIFOs 154$ ~ 1S4a are respectively loaded into ttie 
registers 1S62.158„. 

[1 323 Then, the controller 152 drives the SHIFT/LOAD signal to the shift logic 

level and asserts the WRITE DPSRAM signal, thus serially shifting the data and 
addresses from the registers 1$6i - f 56„ onto the address/data bus 176 and loading 
the data into the corresponding locations of the DPSRAM 102, Specifically, during a 
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fii^t shift cycle, the data and address from the register 156i are shifted onto the bus 
f 76 such that the data from the FIFO 1S4i is loaded into the addressed location of 
the DPSRAM 102. Also during the first shtft cycle, the data and address from the 
register f 56a are shifted into the register 156i, the data and address from the 
5 register I563 (not shown) are shifted into the register f 562, and so on. During a 
second shift cycle, the data and address from the register 156i are shifted onto the 
bus f 76 such that the data from the FiFO f 54^ is loaded into the addressed location 
of the DPSRAM 102. Also during the second shift cycla, the data and address from 
the register 1502 are shifted into the register 156i, the data and address from the 

10 register 1563 {not shown) are shifted into the register 1S6z, and so on. There are n 
shift cycles, and during the nth shift cycle the data and address from the register 
156^ {which is the data and address from the FIFO f 54ft) is shifted onto the bus 
The controlter f 52 may Implement these shift cycles by pulsing the SHIFT/LOAD 
signal^ or by generating a shift dock signal (not shown) tJhat is coupled to the 

15 registers 1S6r1S6n^ Furthermore^ if one of the registers 15Gi-1S6fi is empty during a 
particular shift operation because its con^esponding FIFO 1S4i-154nWBB empty 
when the controlier f 52 loaded the register, then the controller may bypass the 
empty register, and thus shorten the shift operation by avoiding shifting null data and 
a null address onto the bus f 7& 

20 [133] Referring to FIGS. 5 and 6, according to an embodiment of the 

invention, the interface f 44 is similar to the Interface 142, and the interface 132 is 
also similar to the interface 142 except that the interface 132 includes only one write 
channel 150. 

[1341 f^i^* 7 is a block diagram of the interface f 40 of FIG. 5 acconjing to an 

25 embodiment of the Invention. As discussed above In conjunction with FIG. 5, the 
interfeGe 140 reads input data from the DPSRAM f 00 and transfers this data to the 
hardwired 74f-74^. As discussed below, the structure of the interface f40 reduces 
or eliminates data "bottlenecks'' and, where the pipeline circuit 80 (FIG. 5) is a PLIC, 
makes efficient use of the PLIC's local and global routing resources. 

30 [1353 The Interface f40 includes read channels 190i - l&Om one channel for 

each hardwired pipeline 74i - 74^ (FIG« 5), and a controlter 192. For purposes of 
iliustration, the read channel IQQi is discussed below, it being understood that the 
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Operation and struc&ire of the other read channels 190z — 190/, are similar unless 
stated otherv«se. 

[136| The channel 190i includes a FIFO 194i and an address/identifier (ID) 

register IBGi. As discussed below, the Identifier identifies the pipeline 74r74„ that 
makes the request to read data from a particular location of the DPSRAM fOOto 
receive the data. 

[137] The FIFO 1$4i includes two sub-FIFOs (not shown), one for storing the 

address of ihe location \flHthin the DPSRM4 100 from which the pipeline 74i wishes 
to read the Input data, and the other for storing the data read from the DPSRAM 
iOO. Therefore, the FIFO i04t reduces or eliminates the bottleneci^ that may occur 
if the pipeline 74t had to "wait" to provide the read address to the channel i9Qi until 
the controHer 192 finished reading previous data, or if the controller had to wait until 
the pipeiine 74i retrieved the read data before the controller could read subsequent 
data. 

C1 38] The FIFO f 94f mceives the read address from the pipeline 74i via a 

bus 1B8i and provides the address and ID to the register 19Qi via a bus 200i, Since 
the 10 corresponds to the pipeline 74i and typically does not change, the FIFO 194i 
may store the ID and concatenate ttie ID with the address. Alternatively, the pipeline 
74i may provide the ID to the FIFO IMf via ^e bus Furthermore, the FIFO 
iMi receives a READY WRITE FIFO signal from the pipeline 74i via a line 202f . 
receives a CLOCK signai via a line 204r, and provides a FIFO FULL {of read 
addresses) signal to the pipeline via a tine 206^. In addition, the FIFO i94i receives 
a WRITE/READ FIFO signal from the controlier 192 via a line 20Bi, and provides a 
FIFO EMPTY signal to the controller via a line 210i. Moreover, the FIFO 194i 
receives the read data and the corresponding ID from the controiier 192 via a bus 
2f 2, and provides this data to the pipeline 74f via a bus 214i. Where the pipeline 
circuit BO (FIG. 5) is a PLiC, the busses f SSf, 200i, and 214i and the lines 202f. 
204i, 206i, 208i, and 210i are preferably fonned using local routing resources, and 
the bus 212 is typically formed using global routing resources. 

[139| The register 196i receives the address of the location to be read and 

the conresponding ID from the FIFO 194i via the bus 206i, provides the address to 
the port fOSof the DPSRAM 100 (FIG. 5) via an address bus 210, and provides the 
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ID to the contox>iler 192 via a bus 2i8. Furttiermore, the register 196i also receives 
the addresses and IDs from the registers 1962 - 196a via an address/ID bus 220i as 
discussed below. In addition, the register 196^ receives a SHSFT/LOAD signal from 
the controlier 192 via a line 222. Where the pipeline circuit 80 (FIG. 5) is a PLIC, the 
bus 216 is typically formed using global routing resources, and the busses 
220i.220„,i and the line 222 are preferabiy formed using local routing resources. 

t1403 In addition to receiving the FIFO EMPTY signai, generating the 

WRITE/READ FIFO and SHIFT/LOAD signals, and providing the read data and 
corresponding ID, the controller 192 receives the data read from the port 108 of the 
DPSRAM f 00 (FIG. S) via a bus 224 and generates a READ DPSRAM signal on a 
line 226, which couples this signal to the port 108. Where the pipeline circuit 80 
(FIG. 5) is a PLIC, the bus 224 and the line 226 are typically formed using global 
muting resources. 

[1411 Stili refenring to FIG. 7, the operation of the interface 140 is discussed. 

C142i First, the FIFO 194i drives the RFO FULL signal to the logic level 

corresponding to the current state ("fiiir or "not full") of the FIFO relative to the read 
addresses. That Is, if the FIFO 194i is full of addresses to be read, then it drives the 
logic level of FIFO FULL to one level, and if the FIFO is not full of read addresses, it 
drives the logic level of FIFO FULL to another level. 

[143] Next, if the FIFO 194i is not full of read addresses and the pipeline 74i 

is ready for more input data to process, the pipefrne drives the address of the data to 
be read onto the bus 198i, and asserts the READ/WRITE FIFO signal to a write 
level, thus loading the address into the FiFO, As discussed above in conjunction 
with FIG. 5, the pipeline 74i gets the address from the input-date queue f 22 via the 
sequence manager 148. If, however, the FIFO 194i Is full of read addresses, the 
pipeline 74i waits until the FIFO is not full before loading the read address. 

[144| Then, the FIFO 194i drives the FIFO EMPTY signai to the logic level 

corresponding to me current state ("empty" or "not empty") of the FiFO relative to the 
read addresses. That Is, if the FIFO 194^ is loaded with at least one read address, it 
drives the logic level of FIFO EMPTY to one level, and if the FiFO is loaded with no 
read addresses, it drives the logic level of FIFO EMPTY to another ievei. 
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[1453 Na>rt, if the FIFO 194i is not empty, the controller 192 asserts the 

WRITE/READ FIFO signal to the read logic level and drives the SHIFT/LOAD signal 
to the load logic level, thus loading the lirat loaded address and the ID from the FIFO 
into the register 196i. 

[146] The channels IBOz - IBOjt operate In a similar manner such that the 

controller 192 respectively loads the first-ioaded addresses and IDs from the 
FIFOs 1942 - 194n into the registers 196^ - 19%. If all of the FIFOs 1942-194^ are 
empty, then the controller 192 waits for at least one of the FIFOs to receive an 
address before proceeding, 

[147] Then, the controller 192 drives the SHIFT/LOAD signal to the shift logic 

ieve! and asserts the READ DPS RAM signal to serialiy shift the addresses and IDs 
from the registers 196i - 196^^ onto the address and ID busses 216 and 218 and to 
seriaily read the data from the corresponding locations of the DPSRAM 100 via the 
bus 224. 

{148| Next, the contnolier 192 drives the received data and corresponding ID 

— the ID allows eadi of the FIFOs 194i - 194„ to determine \Atiether It is an 
Intended recipient of ISie data onto the bus 212, and drives «ie WRITE/READ 
FIFO signal to a write level, thus senally waiting the date to the respective FIFO, 
194r194n. 

11493 Then, the hardwired pipelines 74r74„ sequentially assert their 

READAA/RITE FIFO signals to a read level and sequentially read the data via the 
busses 214i-214ft. 

li 50] Still referring to FiG. 7, a more detailed discussion of their data-read 

operator is presented. 

[151] During a first shift cycfe, the controller 192 shifts the address and !D 

from the register 196i onto the busses 216 and 218, respectively, asserts read 
DPSRAM, and thus reads the data from the corresponding location of the DPSRAM 
100 via the bus 224 and reads the ID from the bus 218. Next, the controller 192 
drives WRITE/READ FIFO signal on the line 208i to a write level and drives the 
received data and the ID onto the bus 21Z Because the ID is the ID from the FIFO 
f 94f , the FIFO 194i recognizes the ID and thus loads the data from the bus 212 in 
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response the write level of the WRITE/READ FfFO signal The remaining FIFOs 
194^ - 194n do not load the data because the ID on the bus 212 does not 
correspond to their IDs, Then, the pipeiine 74i asserts the READ/WRITE FIFO 
signal on the line 202i to the read ievei and netneves the read data via the bus 214i. 
5 Also during the first shift cycle, the address and iD from the register 1962 are shifted 
into the register 19$i, the address and ID from the register 1963 (not shown) are 
shifted Into the register 1962> and so on. Alternatively, the controller 192 may 
recognize the ID and drive only the WRITE/READ FSFO signal on the iine 208i to the 
write ievef. This eliminates the need for the controner f92 to send the ID to the 
10 FIFOs 194i-194a^ fn another alternative, the WRiTE/READ FIFO sjgnaf may be only 
a read signal, and the FIFO 194i (as well as the other FIFOs 194s-194n) may load 
the data on the bus 212 when the ID on the bus 212 matches the ID of the FIFO 
194i. This eliminates the need of the controller 192 to generate a write signal 

|1523 During a second shift cycle, the address and ID from the register 196^ 

15 is shifted onto the busses 216 and 218 such that the controlfer f 92 reads data from 
the iocation of the DPSRAM 100 specified by the FiFO 1942^ Next, the controlier 
192 drives the WRITE/READ FtFO signal to a write feve! and drives the received 
data and the ID onto the bus 212. Because the ID is the ID from the FIFO f 942, the 
FIFO 1942 recognizes the iD and thus loads the data from the bus 2f 2. The 
20 remaining FIFOs 194^ and 194^ - 194^ do not toad the data because the iD on the 
bus 212 does not correspond to their IDs. Then, the pipeHne 742 asserts its 
READ/WRITE FIFO signaf to the read feve! and retrieves the read data via the bus 
2142^ Also during the second shift cycle, the address and ID from the register 196^ 
is shifted into the register f 96^, the address and ID from the register 196^ (not 
25 shown) is shifted into the register 1962, and so on, 

[153] This continues for n shift c>^les, Le., until the address and SD from the 

register 196^ (which Is the address and ID from the FiFO 194^) are respectiveiy 
shifted onto tiie bus 216 and 218. The controller f 02 may impiement these shift 
cycles by pulsing the SHIFT/LOAD signal, or by generating a shift clock signal (not 
30 shown) that is coupled to the registers 196i-196n. Furthermore, if one of the 
registers 196r1962 is empty during a particuiar shift operation because its 
corresponding FiFO 194^194^ is empty, then the controiler f 92 may bypass the 
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empty register, and thus shorten the shift operation by avoiding shifting a null 
address onto the bus 216. 

[164] Referring to PIGS* 5 and 6, according to an embodiment of the 

invention, the interface 144 is similar to the interface 140, and the interface 136 is 
aiso simiiar to the interface 140 except that the interface f 36 includes only one read 
channei 190, and thus includes no iD circuitry, 

[155] Fig, 8 is a schematic btock diagram of a pipeline unit 230 of FIG. 4 

according to another embodiment of the fnventfon. The pipeline unft 230 Is similar to 
the pipeline unit 78 of FIG. 4 except that the pipeline unit 230 includes multiple 
plpeyne circuits SO — here two pipeiine circuits 80a and 80b. increasing the number 
of pipeline circuits 80 typicaliy allows an increase in the number n of hardwired 
pfpelines 74i-74n, and thus an increase in the functionality of the pipeline unit 230 
as compared to the pipeline unit 78. 

[1S6] In the pipeline unit 230 of FIG, 8, the services components, he., the 

communicatbn interface 82, the controller 86, the exception manager 88, the 
configuration manager 90, and the optional Industry-standard bus Interface 91, are 
disposed on the pipeline circuit 80a, and the pipelines 74i-74n and the 
communication shell 84 are disposed on the pipeiine circuit 80b. By locating the 
services components and the pipelines 74i-74n on separate pipeline cirGults, one 
can include a higher number n of pipelines and/or more complex pipelines than he 
can where the ser^/ice components and the pipelines are iocated on the same 
pipeline circuit. Alternatively, the portion of the communication shell 84 that 
interfaces the pipelines 74^74^ to the interface 82 and the controller 86 may be 
disposed on the pipeline circuit 80a. 

f;i57| FiG. 9 is a schematic block diagram of the pipeline circuits 80a and 

80b and the data memory 92 of the pipeline m\t 230 of FIG. 8 acconjing to an 
embodiment of the invention* Other than the pipeline components being disposed 
on two pipelines circuits, the structure and operation of the pipeiine cirojits 80a and 
80b and the memory 92 of FIG. 9 are the same as for the pipeline circuit 80 and 
memory 92 of FIG* 5* 
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II S8] The preceding discussion is presented to enabfe a person skilled in the 

art to make and use the invention. Various modifications to the embodiments will be 
readily apparent to those skiffed In the art, and the generic principles herein may be 
appiied to other embodfmants and applications without departing from the spirit and 
scope of the present invention. Thus, the present inventjon is not intended to be 
iimited to the embodiments shown, but is to be accorded the widest scope consistent 
with the principles and features disclosed herein. 
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WHAT IS CLAIMED IS: 

1 . A pipeline accaferator, comprising: 
a memory; and 

a hardwired-pipelina circuit coupled to the memory and operable to, 
receive data, 

toad the data into the memory » 

retrieve the data from the memory, 

process the retrieved data, and 

provide the processed data to an e^dernal source. 

2. The pipeline accelerator of claim 1 wherein: 

the memory is disposed on a first integrated circuit; and 
the pipeline circutt is disposed on a second Integrated circuit. 

3. The pipelme accelerator of daim 1 wherein the pipeline circuit is 
disposed on a fiefd-programmable gate array, 

4. The pipeline acceleratDr of claim 1 wherein the pipafine circuit is 
operable to provide the processed data to the external source by: 

loading the processed data into the memory; 
retrieving the processed data from the memory; and 
providing the retrieved processed data to the externa! source, 

5. The pipeiine accelerator of claim 1 wherein: 
the externa! source comprises a processor; and 

the pipeline circuit is operable to receive the data from the processor, 

6» A computing machine, comprising: 
a processor; and 

a pipeline accelerator coupled to the processor and comprising, 
a memory, and 

a hardwired-pipeline circuit coupled to the memojy and operable to, 
receive data from the processor, 
load the data into the memory, 
retrieve the data from the memory, 
process the retrieved data, and 
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provide the pnocessed data to the pfocessor. 

7. A pipeline accelerator, comprising: 
a memory; and 

a hardwired-pipeline circyit coupled to the memory and operable to, 
receive data, 

process the received data, 

load the processed data into the memory, 

retrieve the processed data from the memory, and 

provide the retrieved processed data to an externa! source. 

8. A computing machine, comprising: 

a processor; and 

a pipeline acceferator coupled to the processor and comprising, 
a memory, and 

a hardwired-pipeline circuit coupled to the memory and operable to, 
receive data from the processor, 
process the received data, 
load the processed data into the memory, 
retrieve the processed data from the memory, and 
provide the retrieved processed data to the processor 

9. A pipeline accelerator, comprising: 
first and second memories; and 

a hardwired-pipeline ctrcuit coupled to the first and second memories and 
comprising, 

an input-data handier operabie to receive raw data from an externa! 
source and to load the raw data into the first memory, 

a hardwired pipeitne operable to process the raw data, 

a pipeline Jntarface operabie to retrieve the raw data from the first 
memory, provide the retrieved raw data to the hardw^ired pipeline, and load 
processed data from the hardwired pipeiine into the second memory, and 

an output-data handler operabte to retrieve the processed data from 
the second memory and to provide the processed data to the externaf source. 

10. The pipeiine accelerator of claim 9 wherein: 
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the first and second memories each Include respective first and second ports; 
the input-data handier is operable to load the mw data via the first port of the 

first memory, 

the pipeline interface is operable to retrieve the data via the second port 
of the first memory and to load the processed data via the first port of the second 
memory, and 

the output-data handler Is operable to retrieve the processed data via the 
second port of the second memory, 

1 1 , The pipeiine accelerator of claim 9, ftirther comprising: 
a third memory coupled to the hardwired-pipeline circuit; 

wherein the hardwired pipeline is operabte to generate intermediate data 
while processing the raw data; and 

wherein the pipeline interface is operabie to load the intermediate data into 
the third memory and to retrieve the intermediate data from the third memory, 

12, The pipeline accelerator of claim 9 wherein: 

the first and second memories are respectively disposed on first and second 
integrated circuits; and 

the pipeiine circuit is disposed on a fieid-programmabie gate array. 

13. The pipeline accelerator of daim 9, further comprising: 

an input-data queue coupled to the input-data handler and the pipeiine 

interface; 

wherein the input-data handler Is operabie to toad into the input-data queue a 
pointer to a focation of the raw data within the first memory; and 

wherein the pipeyne interface is operabie to retrieve the raw data from the 
iooation using the pointer, 

1 4. The pipeline acceierator of claim 9, further comprising: 

an outputHdata queue coupled to the output-data handier and the pipeline 
Interface; 

wherein the pipeiine interface is operabie to load into the output-data queue a 
pointer to a iocatron of the processed data within the second memory; and 

wherein the output-data handler is operabte to retrieve the processed data 
from the location using the pointer. 
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1 5. The pipeline accelerator of claim 9, further comprising: 

wherein each of the input-data handler, hardwired pipeline, pipeline interface, 
and output-data handler has a respective operating configuration; and 

a configu ration manager coupled to and operable to sat the operating 
configurations of the input-data handier, hardwired pipeline, pipeiine interface, and 
output-data handler 

16. The pipeiine acceierator of ciaim 9, further comprising: 

wherein each of the input*data handler^ hardwired pipeline, pipeline interface, 
and output-data handler has a respective operating status; and 

an exception manager coupled to and operable to identify an exception in the 
input-data handler, hardwired pipeline, pipeiine interface, or output-data handler in 
response to the operating statuses, 

17. A pipeiine acceierator, comprising: 

a hardwired pipeline operable to process data; and 
an input-data handler coupled to the hardwired pipeline and operable to, 
receive the data, 

determine wtiether the data Is directed to the hardwired pipeline, and 
provide the data to the hardwired pipeiine if the data is directed to the 
hardwired pipeline, 

18. The pipeline acceler^r of claim 17 wherein the input-data handier is 
further operable to: 

receive the data by, 

receiving a message that includes a header and the data, and 
extracting the data from the message; and 
determine whether the data is directed to the hardwired pipeiine by analyzing 
the header. 

1 9* The pipeline accelerator of claim 1 7 wherein the hardwired pipeline 
and the input-data handler are disposed on a single field-programmable gate array. 

20. The pipeline accelerator of claim 17 wherein the hardwired pipefine 
and the Input-data handier are disposed on respective fietd-programmabie gate 
arrays. 
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21 . A oomputing machine, compnsing: 
a processor; and 

a pipeline aoceleratDr coupled to the processor and Gomprising, 
a hardwired pipeline operabfe to process data, and 
an input-data handier coupled to the hardwired pipeline and operable 

to, 

receive the data from the processor, 

determine whether the data is directed to the hardwired pipeline, 

and 

provide the data to the hardwired pipeline if the data is directed 
to the hardwired pipeline, 

22* A pipeiine accelerator* comprisjng: 
a hardwired pipeline operable to generate data; and 
an output-data handier coupled to the hardwired pipeline and operable to, 
receive the data, 

detanTiine a destination of the data, and 
provide the data to the destination. 

23* The pfpeiine accelerator of claim 22 wherein the output-data handler is 
further operable to: 

determine the destination of the data by, 
identifying a type of the data, and 

detemiming the destination based on the type of the data; and 
provide the data to the destination by, 

generating a message that identifies the destination and that includes 

the data, and 

providing the message to the destination. 

24, A computing machine, comprising: 
a processor operable to execute threads of an application; and 
a pipeline accelerator coupled to the processor and comprising: 
a hardwired pipeline operable to generate data, and 
an output-dafa handler coupled to the hardwired pipeline and operable 

to, 
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receive the data* 

jdentify a n^tBBd of the application that subscribes to the data, 

and 

provide the data to the subscribing thread. 

25. A pipeline accelerator, comprising: 

a hardwired pipeline operable to process data values; and 
a sequence manager coupled to and operable to control the operation of the 
hardwired pipeline. 

26. The pipeline acceierator of claim 25 wherein the sequence manager is 
operabie to controi an order in which the hardwired pipeline receives the data 
values. 

27- The pipeline accelerator of ciaim 25 wherein the sequence manager Is 
further operate to: 

receive an event; and 

control the hardwired pipeline in response to the event. 

28, The pipeline accelerator of c!aim 25 wherein the sequence manager is 
further operafaie to: 

receive a synchronization signal; and 

controi the operation of the hardwired pipeline in response to the 
synchronization signal 

29, The pipeline acceierator of ciaim 25 wherein the sequence manager is 
further operable to: 

sense an occurrence relative to the hardwired ptpef ine; and 
generate an event in response to the occurrence. 

30, A computing machine, comprising: 

a processor operable to generate data and an event; and 

a pipeline accelerator coupled to flie processor and comprising, 

a hardwired plpeiine operable to receive the data from the processor 
and process the received data; and 
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a sequence manager coupled to the hardwired pipeline and operable 
to receive the event from the pnocessor and to control the operation of the hardwired 

pipeline in response to the event 

31 V A pipeline acceferator, (X)mprisjng: 

a hardwired-'pipenne circuit having an operating configuration and operable to 
process data; and 

a contlguratfon manager coupied to the hardwired-pipeline circuit and 
operable to set the operating configuration* 

32, The pipeiine accelerator of daim 31 wherein: 

the hardwired-pipeline circuit inoiudes a configuration register; and 
the configuration manager is operable to sat the operating configuration by 
loading a configuration vaiue Into the configuration register, 

33, The pipeline accelerator of claim 32 vyherein the configuration manager 
is operable to receive the configuration vaiue from an external source, 

34, A computing machine, comprising; 

a processor operable to generate data and a configuration vatue; and 
pipeline accelerator coupled to the processor and comprising, 

a hardwired-pipeline circuit having an operating configuration and 
operable to process the data, and 

a configuration manager coupled to the hardwired-pipeline circuit and 
operable to set the operating configuration in response to the configuration value. 

35- A pipeline accelerator, comprising; 

a hardwired-pipeline circuit having an operating status and operable to 
pmcess data: and 

an exception manager coupied to the hardwired-pipeline circuit and operable 
to identify an exception in the operation status of the hardwired-pipeline circuit in 
response to the operating status. 

36, The pipeline accelerator of claim 35 wherein: 
the hardwired-pipeline circuit is operable to generate a status value that 
represents the operating status; and 
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the exception manager is operable to Identify the exception in response to the 
status value, 

37. The pipeline accelerator of claim 36 wherein: 

the hardwired-pipeline circuit Inciudes a status register that is operable to 
store the status value; and 

the exception manager receives the status value from the status register. 

38. The pipeline acceierator of claim 35 wherein the exception manager is 
operable to Identify an exceptionin the operating status of the hardwired-pipeline 
circuit to an externa! soorce. 

39. A computing machine, comprising: 

a processor operable to generate data; and 

a pipeline accelerator, comprising, 

a hardwired-pipeline circuit having an operating status and operable to 
process data and to generate a status value that represents the operating status, 
and 

an exception manager coupled to the hardwired-pipeline circuit and 
operable to identify an exception in the operating status of the hardwired-pipetine 
circuit in response to the status value and to notify the processor of the exception. 

40. A computing machine, comprising: 
a pipeline acceferator, comprising, 

a hardwired-pipe! ine circuit having an operating status and operabie to 
process data, and 

an exception manager coupled to the hardwired-pipeline circuit and 
operable to generate a status value that represents the operating status; and 

a processor coupied to the pipeline accelerator and operable to generate the 
data, to receive the status value, and to determine whether the hardwired-pipeline 
circuit is malfunctioning by analyzing the status value, 

41 - A method, comprising: 
ioading data into a memory; 
retrieving the data from the memory; 

processing the ratneved data with a hardwired-pipetine circuit; and 
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providing the pnooessed data to an ejdernal source. 

42. The method of datm 41 wherein providing the processed data 
comprises: 

loading the processed data into the memory; 
retrieving the processed data fnom the memory; and 
providing the retrieved processed data to the external source. 

43* A method, comprising: 

processing data with a hardwired-pipeline drcuit; 

loading the processed data into a memory; 
retrieving the processed data from the memory; and 
providing the retrieved processed data to an externa! source, 

44. A method, comprising: 

loadmg raw 4BtB from an external source into a first memory; 
retrieving the raw data from the first memory; 
processing the retrieved data with a hardwired pipeHne; 
loading the processed data from the hardwired pipeline into a second 
memory; and 

providing the processed data from the second memory to the external source. 

45. The method of claim 44 wherein: 

loading the raw data comprises loading the raw data via a first port of the first 
memory; 

retrieving the raw data comprises retrieving the raw data via a second port of 
the first memory; 

ioading the processed data comprises loading the processed data via a first 
port of the second memory; and 

providing the processed data comprises retrieving the proc^sed data via a 
second port of the second memory. 

46. The method of claim 44, further comprising: 

generating jntarmediata data with the hardwired pipeline in respDnse to 
processing the raw data; 

foading the intermediate data into a third memory; and 
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providing the interrnediate data from the third memory back to the hardwired 
pipeline. 

47. The method of claim 44, further comprising: 

loading into an input-message queue a pointer to a location of the raw data 
within the first memory; and 

wherein retrieving the raw data comprises retrieving the raw data from the 
iocation using the pointer 

48- The method of ciafm 44, further comprising: 

loading into an output-message queue a pointer to a location of the processed 
data within the second memojy; and 

wherein retrieving the processed data comprises retrieving the processed 
data from the location using the pointer, 

49. The method of claim 44, further comprising setting parameters for 
ioading and retrieving the raw data, processing the retrieved data, and loading and 
providing the processed data. 

50. The method of claim 44, further comprising determining whether an 
error occurs during the foading and retrieving of the raw data, the processing of the 
retrieved data, and the ioading and providing of the processed data, 

51 . A method, comprising; 
receiving data; 

determining whether the data is directed to a hardwired pipeline; and 
providing the data to the hardwired pipeifne if the data is directed to the 
hardwired pjpeiine* 

52. The method of ciaim 51 wherein; 
receiving the data comprises, 

receiving a message that includes a header and the data, and 
extracting the data from the message; and 
determining whether the data is directed to the hardwired pipeline comprises 
analyzing the header 

53. A method, comprising: 
generating data with a hardwired pipeline; 
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determining a destination of the data; and 
providing the data to the destination. 

54- The method of daim 53 wherein: 
determining the destination of the data comprises, 
identifying a type of the data, and 

determiiiing the destination based on the type of the data; and 
providing the data to the destination comprSses, 

generating a message that identifies the destination and that includes 
the data, and 

providing the message to the destination. 

55. A method, comprising: 

processing data values with a hardwired pipeyne; and 
sequencing the operation of the hardwired pipeline. 

56. The method of daim 55 wherein sequencing the operation comprises 
sequencing an order in which the hardwired pipeltna processes the data values, 

67, The method of claim 55 wherein sequencing the operating comprises 
synchronizing the operation of the hardwired pipe}ine to a synchronization signal 

58. The method of daim 55, further comprising: 

sensing a predefined occurrence during operation of the hardwired pipeline; 

and 

generating an event io response to the occurrence- 

59* A method, comprising: 
loading a configuration value into a register; and 
setting an operating configuration of a hardwired pipeiine with the 
configuration value. 

60. A method, comprising: 

processing data with a hardwired pipeline; and 

ident}fylng an error in the processed data by analysing an operating status of 
the hardwired pipeline. 

61 , A method for designing a hardwired-pipeline circuit, comprising: 
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retrieving fnom a Hbrary a first data representation of a communication 
interface: 

generating a second data representation of a hardwired pipeNne that is to be 
coupted to the communication interface; and 

combining the first and second data representations to generate 
hard-configyration data for the hardwired-pipeline cirouit. 

62. The method of claim 61 , further comprising modifying the first data 
representation by selecting values for predetermined parameters of the services 
iayer before combining the first and second data representations. 

63. The method of ciaim 61 wherein the communicatton interface Is 
operabie to ailow the hardwired-pipeiine circuit to communicate with another circuit. 

64. The method of claim 61 wherein combining the first and second data 
representations comprises compilmg the first and second data representations into 
the hard-configuration data. 

65. The method of claim 61 wherein the hard-configuration data comprises 
firmware. 
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